
SYNCHRONIZATION METHOD AND SYSTEM FOR KEEPING 
TRACK OF EN CODING HISTORY TO MAINTAIN DIGIT AT. 

SYSTEM SYNCHRONIZATION DURING 
COMMUNICA TION OVER LOSSY TRANSMISSION MEDIA 

Field Of The Invention 

The present invention relates to communication systems and in 
particular to a synchronization method and mechanism to maintain synchronization 
between sending and receiving digital systems conunimicating over a lossy 
transmission media. 

Background Of The Invention 

Packet-switched digital communication networks allow digital systems 
to communicate with each other. In these communication networks, data to be 
transmitted from one digital system to another is loaded into frames. The frames are 
then transmitted over the communication network to the destination digital system as 
packets. Often it is advantageous to compress the data before the data is transmitted 
as this reduces the amount of data to be transmitted over the communication network. 
It is also often desired to scramble or encrypt the data prior to transmission. When 
compressing, scrambling or encrypting data, it is necessary to ensure the transmitting 
digital system and receiving digital system remain in synchronization. Otherwise, the 
data encoding and decoding method will operate erroneously. 

U.S. Patent No. 5,130,993 to Gutman et al discloses a method for 
transmitting encoded data over unreliable networks wherein synchronization between 
the encoder and decoder is maintained. When encoded data is received by one 
system, the data is checked for transmission errors after the data has been decoded. If 
an error is detected, a reset signal is sent by the receiving system to the sending 
system to reset its encoder to a predetermined state known to the receiving system. 
The corrupted data can then be resent and decoded by the receiving system. In this 
manner, the synchronization of encoder and decoder can be maintained. 

When the encoder is reset to a predetermined state, there is a reduction 
in encoding efficiency since the encoding algorithm must releam its vocabulary. In 
prior art systems, such as that disclosed by Gutman, the predetermined state does not 
take advantage of encoding history between the encoder and decoder resulting in 
reduced system performance. 
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It is therefore an object of the present invention to provide a novel 
synchronization method and mechanism for maintaining synchronism between digital 
systems commimicating over a lossy transmission media. 

5 Summary Of The Invention 

According to one aspect of the present invention there is provided a 
method for transmitting encoded data between synchronized sending and receiving 
digital systems across a lossy transmission media, said sending and receiving digital 
systems maintaining encoder and decoder information records, said method 
10 comprising the steps of: 

encoding packet data to be transmitted by said sending digital system 
using encoding information in an encoder information record that has been previously 
acknowledged by said receiving digital system; 

building a new encoder information record including the encoding 
15 information used to encode said packet data as well as the packet data; 

transmitting the encoded packet data to said receiving digital system as 
a packet including a header having a packet nimiber and a tag identifying the 
encoding information used to encode the packet data; 

when the packet is received by said receiving digital system, 
20 examining the header to determine the encoding information used to encode said 
packet data; 

decoding the packet using corresponding decoder information in said 
decoder information record and updating the decoder information in said decoder 
information record with said packet data; 

25 acknowledging processing of the packet to said sending digital system 

to enable said sending digital system to update said encoder information so that said 
new encoder information record is used to encode packet data; and 

when the packet is lost, conditioning said encoder information to 
rebuild the new encoder information without the lost packet data. 

30 The present invention provides advantages in that if data packets are 

lost, the encoder of the sending digital system is conditioned to rebuild the 
imacknowledged encoder history/state information record without the missing packet 
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data. Encoding can continue using the current or previously acknowledged encoder 
history/state information records. Thus, encoding history is used to the extent 
possibly even when packets are lost reducing the amount of vocabulary the encoding 
algorithm must releam. 

5 

Brief Description Of The Drawings 

An embodiment of the present invention will now be described more 
fully with reference to the accompanying drawings in which: 

Figure 1 is a schematic block diagram of a packet-switched digital 
10 conrununication system; 

Figures 2a and 2b are schematic block diagrams of sending and 
receiving digital systems forming part of the commimication system of Figure 1 
including synchronization mechanisms in accordance with tiie present invention; 

Figures 3a and 3b are illustrations of encoder history/state information 
1 5 records stored by the synchronization mechanism of Figure 2a; 
CI Figures 4 to 6 are flow charts illustrating the operation of the 

synchronization mechanisms of Figures 2a and 2b. 



5i 



C I Detailed Description Of The Preferred Embodiment 

20 Turning now to Figure 1, a communication system is shown and is 

generally indicated to by reference numeral 10. As can be seen, communication 
system 10 includes a pair of digital systems 12 and 14 which communicate over a 
lossy transmission media 16 in the form of an unreliable packet-switched digital 
communication network. During transmission of data from one digital system to the 

25 other, the sending digital system 12 loads the data into frames. The sending digital 
system 12 also compresses and/or encrypts (scrambles), hereinafter referred to as 
"encodes", the data using encoder information known to the receiving digital system. 
Once encoded, the data frames are encapsulated with headers as will be described and 
are transmitted as packets over the lossy transmission media 16. 

30 As each data packet is received, the receiving digital system 14 

compares the packet number assigned to the received packet with the packet number 
of the expected packet to ensure each packet is received. If the packet is expected, the 



receiving digital system processes the packet using decoder information. During 
processing, packet infomiation is used to update the decoder information 
corresponding to the encoder infomiation. Once processed, the receiving digital 
system 14 sends an acknowledgment (Ack) packet to the sending digital system 12 
acknowledging processing of the packet thereby allowing the sending digital system 
to update its encoder information. If the digital systems are involved in bi-directional 
data exchange, acknowledgment headers are used to encapsulate data frames in order 
to acknowledge receipt of packets. 

Since the data frames are encoded, it is necessary to ensure that the 
digital systems 12 and 14 remain in synchronization. Otherwise, data will be decoded 
erroneously. To maintain the digital systems in synchronization, each of the digital 
systems includes a synchronization mechanism 1 8 in accordance with the present 
invention (see Figures 2a and 2b). The synchronization mechanisms 18 establish a 
protocol that allows the digital systems 12 and 14 to keep track of each others - 
encoding history and state information. Further specifics of the synchronization 
mechanisms 18 will now be described. 

Figure 2a better illustrates the sending digital system 12. As can be 
seen, the digital system 12 includes an encoder 20 to encode data to be transmitted 
and to load the data into frames. History and state information concerning the state of 
the encoder 20 is recorded in memory 22. The synchronization mechanism 18 
communicates with the encoder 20 and the memory 22 as well as with the lossy 
transmission media 16. 

Figure 2b better illustrates the receiving digital system 14. As can be 
seen, the digital system 14 also includes a synchronization mechanism 18 and a 
decoder 24 to decode data received from the sending digital system 12, History and 
state information concerning the state of the decoder 24 is recorded in memory 26. 

Figures 3a and 3b show an example of the encoder history/state 
information recorded in memory 22. In this case, the encoder history/state 
information includes three records, namely record Rec. N-1, record Rec. N and record 
Rec. N+1 . Each record includes a sum of processed information of the previous 
record and the packets acknowledged by the receiving digital system 14 after 
acknowledgment of the packets for the previous record. Typically each record will 



include the sum of processed information of the previous record plus the next packet 
acknowledged by the receiving digital system. However, if desired, the receiving 
digital system 14 can be conditioned to send acknowledgments after multiple packets 
have been processed. Record Rec. N-1 is encoder history/state information that has 
been previously acknowledged by the decoder 24. Record Rec. N is the current or 
most recent encoder history/state information that has been acknowledged by the 
decoder 24. Record Rec. N+1 is encoder history/state information that has not yet 
been acknowledged by the decoder 24. 

When data is to be transmitted by digital system 12, the 
synchronization mechanism 18 encapsulates each encoded packet with a header 
including a number of tags. Specifically, each header includes an 
Encode_Hist_Tag_Used tag identifying the history/state information used by the 
encoder 20 to encode the packet, that has been acknowledged by the receiving digital 
system 14, a Pkt_Tag tag identifying the packet number assigned to the packet and an 
Acking_Peer_Encoder_Hist_Tag tag acknowledging the most recent decoder 
history/state information processed by decoder 24 that is known by the sending digital 
system 12, 

The synchronization mechanism 18 also generates synch control (Ctl) 
and synch response packets. These packets are generated when the sending and 
receiving digital systems 12 and 14 have become imsynchronized and are used to re- 
synchronize them. The synch control packet includes a Ctl_Pkt_Tag tag assigning a 
number to the synch control packet so that it may be matched up with its 
corresponding synch response packet and a Last_Acked_Peer_Xmit_Hist_Tag tag 
identifying the last known acknowledged state at which the sending and receiving 
digital systems 12 and 14 were synchronized. The synch response packet also 
includes a Ctl_Pkt_Tag tag assigning a nimiber to the synch response packet so that it 
may be matched up with its corre^onding synch control packet. 

The operation of the synchronization mechanisms 18 will now be 
described with particular reference to Figures 4 to 6, In this particular example, it will 
be assumed that only digital system 12 is transmittmg data packets. Accordingly, in 
response to each received and processed packet, the receiving digital system 14 
returns an acknowledgment packet. 
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When the sending digital system 12 initiates data transmission, the 
encoder 20 encodes the data to be transmitted using history/state information stored in 
the memory 22 that has been acknowledged by the receiving digital system 14 and 
loads the encoded data into frames. Accordingly, in the example of Figure 3a, the 
5 encoder 20 can use records Rec. N-1 or Rec. N to encode the data since these records 
have been acknowledged by the decoder 24. The encoder 20 however, cannot use 
record Rec. N+1 to encode the data since this record has not been acknowledged by 
the decoder 24, As each frame is loaded, the synchronization mechanism 18 
encapsulates the frame with a header as described previously and transmits the data 
1 0 packet to the receiving digital system 1 4 over the lossy transmission media 1 6. 
^ J When the packet is received by the receiving digital system 14, a 

U1 cyclic redundancy check (CRC) is performed on the packet to determine if the data in 

? i the packet is uncorrupted (block 1 00). If the packet data is corrupted, the packet is 

jj! discarded (block 102) and the receiving digital system 14 awaits the next data packet 

1=^ 15 (block 104). If the packet data is uncorrupted, the synchronization mechanism 18 of 

£1 . the receiving digital system 14 examines the packet header to determine the packet 

(block 106). If the packet is a data packet, the synchronization mechanism 18 
U I examines the Pkt_Tag tag of the header to determine if the received packet is the 

S { expected packet (block 108). 

20 If the data packet is the expected packet, the packet is placed in a 

queue. Sequential packets in the queue are processed by the digital system 14 (block 
112). In order to process each packet, the decoder 24 uses the 
Encode_Hist_Tag_Used tag of the packet header to determine the history/state 
information used by the encoder 20 to encode the packet data. The decoder then 
25 extracts the corresponding history/state information from the memory 26 and decodes 
the packet. 

Once the decoder 24 has processed the packet, the decoder updates the 
history/state information using the packet. The decoder then generates an 
acknowledgment packet (block 118). The acknowledgment packet is returned to the 
30 sending digital system 12 to acknowledge receipt of the packet and inform the 

sending digital system 12 that it should update the encoder history/state information 



used to encode packets. Following this, the receiving digital system 14 awaits receipt 
of the next packet (block 104). 

If the packet number of the data packet is not the packet number of the 
expected packet but is within a defined range of the expected packet number, 
signifying the packet has been received out of sequence (block 120), the packet is 
placed in the queue and a packet timer for the missing packet is initiated (block 122). 
The receiving digital system 14 then waits for the next packet (block 104). If the 
missing packet is received before the packet timer expires, all sequential packets in 
the queue are processed at block 1 12 and the packet timer is stopped (block 116). 

If the packet number of the data packet is outside of the predefined 
range of the expected packet number, the packet is discarded (block 102) and the 
receiving digital system 14 awaits receipt of the next packet (block 104). 

If the packet timer expires before it has been stopped at block 116 
(block 130), the synchronization mechanism of the receiving digital system 14 - 
transmits a synch control packet to the sending digital system 12 signifying an 
unsjmchronized state and informing the sending digital system 12 of its current 
decoder history/state information. The synchronization mechanism 18 also 
increments a synch control transmit counter (block 134). The synchronization 
mechanism 18 then starts a synch timer and awaits receipt of a synch response packet 
fi-om the sending digital system 12 (block 136). 

After the synch control packet has been sent, the synchronization 
mechanism also conditions the decoder 24 to process packets in the queue until the 
next missing packet is detected. A variable is set to remember to where in the queue 
packets have been processed. 

If a synch response packet is received (block 137) fi-om the sending 
digital system 12 before the synch timer expires, the synch timer is stopped (block 
138). The synchronization mechanism 18 then generates the acknowledgment packet 
in response to the variable set at block 132 (block 145) and the receiving digital 
system 14 awaits the next packet (block 104). If the synch timer expires (block 139), 
the count of the synch control transmit counter is examined to determine if the count 
value exceeds a threshold (block 140). If not, the synchronization mechanism returns 
to block 134. Thus, the synchronization mechanism 18 transmits another synch 



control packet to the sending digital system 12 and increments the synch control 
transmit counter. 

At block 140, if the count of the synch control transmit coimter is 
determined to equal the threshold, the link between the sending and receiving digital 
systems is reset (block 142). 

When the sending digital system 12 receives a packet from the 
receiving digital system 14, the synchronization mechanism 18 checks the packet to 
determine if the packet is corrupted (block 100). If so, the packet is discarded (block 
102). If the packet is imcorrupted, the synchronization mechaiusm 18 checks the 
packet to determine if it is a data packet (block 106). In this example, the sending 
digital system 12 receives from the receiving digital system 14 either 
acknowledgment packets signifying proper receipt of transmitted packets or synch 
control packets signifying an unsynchronized state between the sending and receiving 
digital systems 12 and 14. 

If the incoming packet is an acknowledgment packet (block 146), the 
sending digital system 12 uses the Acking_Peer_Encoder_Hist_Tag tag of the packet 
header to update the history/state information of the encoder 20 so that record Rec. 
N+1 becomes record Rec. N. (block 118). This new encoder history/state information 
record Rec.N can then used by the encoder 20 to encode data since the history/state 
information has been acknowledged by the receiving digital system 14. 

If the incoming packet is a synch control packet (block 150), the 
synchronization mechanism 18 of the sending digital system 12 uses the 
Last_Acked_Peer_Xmit_Hist_Tag tag to condition the encoder to rebuild record Rec. 
N+1 without using the missing packet (block 152). The synchronization mechanism 
18 also sends a synch response packet to the receiving digital system 14 having a 
number equal to the number assigned to the received synch control packet (block 
154). 

As mentioned previously, when the receiving digital system 14 
receives the synch response packet, the synchronization mechanism 18 matches the 
synch response packet with the transmitted synch control packet and stops the synch 
timer (block 138). The synchronization mechanism 18 then generates an 
acknowledgment packet acknowledging the packets in the queue that were processed 



up to the set variable (block 145). At this point, the sending and receiving digital 
systems 12 and 14 are considered to be resynchronized and the process continues. 

As will be appreciated in this embodiment, when the history/state 
information in the memories is being updated, multiple records of the history/state 
information are maintained. Altematively, deltas reflecting changes to the 
history/state information records can be stored to reduce memory usage. 

For example if packet M+1 is lost and its information is used in 
encoder history/state information record Rec. N+1, a synch control packet is sent by 
the synchronization mechanism 18 to the sending digital system 12 acknowledging 
the last processed packet M. When the synchronization mechanism 18 of the digital 
system 12 receives the synch control packet, it conditions the encoder 20 to discard 
record Rec. N+1 and the packet M+l information, and to rebuild record Rec. N+1 by 
summing the information of record Rec. N with the information of packets M + 2, . . . 
M + j. Once all of the packets M + 2 to M + j are acknowledged by the 
synchronization mechanism, record Rec. N+1 becomes record Rec. N and the encoder 
can use this record to encode packets. 

As will be appreciated, when the sending and receiving digital systems 
become unsynchronized, the encoder history/state information is conditioned to the 
last known point at which the digital systems were known to be synchronized and not 
to its initial state as is common in prior art systems. This allows synchronization 
between the sending and receiving digital systems to be less tightly coupled. In this 
manner, encoding efficiency can be maintained since pirior encoder history/state 
information is not lost. As a result, compressibility need not be reduced significantly 
when packet loss is detected and retransmission of lost data is required. This is 
particularly attractive when transmitting packetized data over unreliable networks 
such as the Internet and Frame Relay and IP networks. 

Also, although the encoder history/state information is described as 
being conditioned to the last known synchronization state of the sending and receiving 
digital systems, the encoder history/state information can be conditioned in some 
instances to other prior non-initial states. Of course, conditioning the encoder 
history/state infomiation to the last known synchronization state increases encoding 
efficiency. 
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Although the receiving digital system is described as sending 
acknowledgment packets to the sending digital system in response to received 
packets, those of skill in the art will appreciate that bi-directional communication 
between the digital systems can occur. In this instance, packet acknowledgment 
headers are used to encapsulate data frames to be transmitted by the receiving digital 
system to acknowledge receipt of the packets. 

Although a preferred embodiment of the present invention has been 
described, those of skill in the art will appreciate that variations and modifications 
may be made without departing from the spirit and scope thereof as defined by the 
appended claims. 



